Implementing the Levenberg-marquardt Algorithm On-line: a Sliding Window Approach with Early Stopping
نویسندگان
چکیده
The Levenberg-Marquardt algorithm is considered as the most effective one for training Artificial Neural Networks but its computational complexity and the difficulty to compute the trust region have made it very difficult to develop a true iterative version to use in on-line training. The algorithm is frequently used for off-line training in batch versions although some attempts have been made to implement iterative versions. To overcome the difficulties in implementing the iterative version, a batch sliding window with Early Stopping version, which uses a hybrid Direct/Specialized evaluation procedure is proposed and tested with a real system. Copyright © 2004 IFAC
منابع مشابه
A sliding window solution for the on-line implementation of the Levenberg-Marquardt algorithm
The Levenberg-Marquardt algorithm is considered as the most effective one for training Artificial Neural Networks but its computational complexity and the difficulty to compute the trust region have made it very difficult to develop a true iterative version to use in on-line training. The algorithm is frequently used for off-line training in batch versions although some attempts have been made ...
متن کاملOne-Dimensional Modeling of Helicopter-Borne Electromagnetic Data Using Marquardt-Levenberg Including Backtracking-Armijo Line Search Strategy
In the last decades, helicopter-borne electromagnetic (HEM) method became a focus of interest in the fields of mineral exploration, geological mapping, groundwater resource investigation and environmental monitoring. As a standard approach, researchers use 1-D inversion of the acquired HEM data to recover the conductivity/resistivity-depth models. Since the relation between HEM data and model ...
متن کاملA new Levenberg-Marquardt approach based on Conjugate gradient structure for solving absolute value equations
In this paper, we present a new approach for solving absolute value equation (AVE) whichuse Levenberg-Marquardt method with conjugate subgradient structure. In conjugate subgradientmethods the new direction obtain by combining steepest descent direction and the previous di-rection which may not lead to good numerical results. Therefore, we replace the steepest descentdir...
متن کاملNovel Levenberg-Marquardt based learning algorithm for unmanned aerial vehicles
In this paper, a Levenberg-Marquardt inspired sliding mode control theory based adaptation laws are proposed to train an intelligent fuzzy neural network controller for a quadrotor aircraft. The proposed controller is used to control and stabilize a quadrotor unmanned aerial vehicle in the presence of periodic wind gust. A proportional-derivative controller is firstly introduced based on which ...
متن کاملTemperature-Based Feed-Forward Backpropagation Artificial Neural Network For Estimating Reference Crop Evapotranspiration In The Upper West Region
The potential of modeling the FAO Penman-Monteith (FAO-56 PM) method for computing reference crop evapotranspiration (ETo) using feed-forward backpropagation artificial neural networks (FFBANN) with minimal measured climate data such as with the air temperature (maximum and minimum) was investigated using local climatic data from the Wa Meteorological weather station. Three FFBANN models were d...
متن کامل